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Abstract We formulate and prove a quantum Shannon-McMillan theorem. 
The theorem demonstrates the significance of the von Neumann entropy for 
translation invariant ergodic quantum spin systems on Z^-lattices: the en- 
tropy gives the logarithm of the essential number of eigenvectors of the 
system on large boxes. The one-dimensional case covers quantum informa- 
tion sources and is basic for coding theorems. 



CN 

1. Introduction 

o 

^ | The classical Shannon-McMillan theorem states that, for an ergodic shift 

system over a finite alphabet (spin chain, data stream, discrete stochas- 
tic process...) the distribution on a box of large volume v is essentially 
carried by a 'typical set' of approximate size exp(vh) with h being the 
Kolmogorov-Sinai dynamical entropy of the system, which in our case 
is identical to the mean (base e) Shannon entropy. Each element of this 
typical set has a probability of order exp(— vh). The latter fact is usually 
called asymptotic equipartition property (AEP). In order to simplify the 
arguments throughout this introduction we confine ourselves to the one- 
dimensional case. Thus instead of large boxes we consider n-blocks with 
n large. In classical information theory the one-dimensional lattice systems 
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model information sources. The AEP is of major importance for source 
coding (c.f. [20]). It implies the possibility of lossless transmission for 
an n-block message, using typically only nhj 'log 2 bits. The fact that on 
the typical set the probabilities of all elements are of the same magnitude 
implies that better compression is (again typically) impossible. 

Considering an ergodic quantum spin lattice system (again, for sim- 
plicity, one-dimensional), we prove that the n-block state is essentially 
carried by a typical subspace (of the entire Hilbert space) of dimension 
close to exp(ns). Each one-dimensional projector into that subspace has 
an expected value of order exp(— ns). Here s is the mean von Neumann 
entropy of the system. The reduction of this statement to the commutative 
setting is exactly the 'classical' theorem. 

Several attempts have been made to establish a quantum version of the 
Shannon-McMillan theorem for stationary quantum systems. Due to the 
fact that in quantum theory there exist several entropy notions (cf. [1]), 
depending on e.g. how the measuring process is incorporated, there is a 
number of different approaches. The paper [13] of King and Lesniewski 
concerns the classical stochastic process obtained from an ergodic quan- 
tum source by measurements of the individual components and derives an 
asymptotic dimension of a relevant subspace in terms of the classical mean 
entropy. This relevant subspace however is in general not minimal, and con- 
sequently not optimal for compression purposes. In particular, the AEP is 
not fulfilled for this subspace. For the Bernoulli case (of independent com- 
ponents) the King/Lesniewski result is optimal and consistent with the ear- 
lier result by Jozsa and Schumacher [12]. 

In the paper [7] Hiai and Petz, using a considerably stronger condition 
of complete ergodicity derived upper and lower bounds (in terms of the 
von Neumann mean entropy) for the asymptotic dimension of a minimal 
relevant subspace. In view of our results it turns out that the upper bound 
is sharp. However the results in [7] concern the more general situation of 
estimating minimal projectors with respect to a reference state in terms 
of relative entropy. For the special cases of ergodic Gibbs quantum lattice 
systems, [9], respectively for ergodic algebraic states, [8], Hiai and Petz 
could prove the Shannon-McMillan theorem. For the Gibbs situation they 
even established the convergence in the strong operator topology in the 
corresponding GNS representation. 

For further special classes of quantum systems, namely for a lattice ver- 
sion of free bosons or fermions, Johnson and Suhov present a proof of 
a quantum Shannon-McMillan theorem, [11]. The authors use occupation 
numbers and their relation to the eigenvalues of Gibbs ensemble density 
matrices to obtain a sequence of independent (not identically distributed) 
random variables. It turns out that this classical process has a mean entropy 
which is precisely the mean von Neumann entropy of the corresponding 
quantum system. 
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Also in the context of quantum statistical mechanics Datta and Suhov 
[6] prove a Shannon-McMillan theorem for some weakly non-stationary 
sequence of local quantum Gibbs states in the neighborhood of a classical 
system. The authors use the quantum AEP to derive a reliable compres- 
sion/decompression scheme which compresses the quantum state according 
to the von Neumann entropy rate. 

Neshveyev and St0rmer considered the CNT-entropy in the context of 
asymptotically abelian C* -dynamical systems with locality in order to de- 
rive bounds for the asymptotic dimension of a typical subspace, [15]. They 
obtained a Shannon-McMillan result for the special case of tracial states 
which covers the classical result. For our quantum lattice systems however 
this essentially reduces to the situation of Bernoulli states, where the indi- 
vidual components are even supposed to be in the trace state. 

Let us discuss, in an informal way, the main ideas behind the proof of 
the quantum Shannon-McMillan theorem presented here. 

At the beginning, we follow mainly the approach of Hiai and Petz [8]. 
It is well known that one can find a classical subsystem (maximal abelian 
subalgebra of the entire non-commutative algebra of observables) of the 
n-block quantum system with Shannon entropy equal to the von Neumann 
entropy S n of the full n-block quantum state. Starting from this abelian n- 
block algebra we construct an abelian quasilocal algebra. It is a subalgebra 
of the entire quasilocal algebra of the infinite quantum lattice system. Re- 
stricting the given quantum state to this classical infinite lattice system we 
obtain a stochastic process. The k-th component of this process is related 
to the k-th n-block of the original system. This classical process is ergodic 
if one assumes for instance complete ergodicity of the original system as 
Hiai and Petz do in their paper. We know from classical Shannon-McMillan 
that the probability distribution of a large A: -block of this classical system 
(corresponding to a fcn-block of the quantum system) has an essential sup- 
port of size e k ' h (and entropy close to k ■ h < k ■ S n ). Here h denotes the 
mean entropy of the classical system, which is in general smaller than S n , 
due to possible correlations. For the quantum context this translates into the 

existence of an essentially carrying subspace of dimension e k ' h for the kn- 
block. With s being the mean von Neumann entropy, we arrive (for large 
n) at an estimate kn ■ s ~ k ■ S n > k ■ h > kn ■ s, and infer the existence 

of an (at most) e k ' h ~ e kn ' s -dimensional essentially carrying subspace 
('typical subspace') of a fcn-block of the quantum system. If we would take 
into account that the quantum system might have a still smaller ('better' 
from the point of view of resources needed) typical subspace (compared to 
what is delivered by the constructed classically restricted system) we would 
have arrived at the result that e n ' s is an asymptotic upper bound for the di- 
mension of a typical subspace of the quantum system. So far, we followed 
the ideas of Hiai and Petz [7], where under the assumption of complete 
ergodicity estimates for the typical dimension were derived. 
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In fact, we can extend this result obtaining not only upper and lower 
bounds but a limit assertion for the dimension of a typical subspace. In- 
stead of complete ergodicity we require only ergodicity, thus establishing a 
quantum Shannon-McMillan theorem. 

Beyond technicalities, this can be accomplished by 

a) observing that we do not have to take into account the possibility that 
the quantum system behaves 'better' than the classical one (see some lines 
above): The very fact that the asymptotic von Neumann entropy of a large 
n-block is n ■ s excludes the possibility of an essentially carrying subspace 
of dimension significantly smaller than e n ' s . In fact, the contribution to the 
entropy due to this subspace would be smaller than n ■ s. The non-typical 
part yields only a contribution of the order o(n). This is due to a uniform 
integrability argument (based upon Lemma 3.3) and 

b) the condition of complete ergodicity can be avoided, since a quantum 
analog of the following result concerning classical systems can be shown 
(Theorem 3.1): if a dynamical system is ergodic with respect to the trans- 
formation T, then, though it may be non-ergodic with respect to T n (for a 
given n > 2), all of its T n -ergodic components have the same entropy, and 
the number of ergodic components is at most n. 

Note that the absence of complete ergodicity therefore reflects some 
intrinsic periodicity of the system. Periodicities naturally appear in a large 
variety of stationary (quantum) stochastic processes. 

Finally let us mention that the techniques used here to derive the quan- 
tum Shannon-McMillan theorem can be modified to prove a quantum ver- 
sion of Breiman's strengthening (in the sense of pointwise convergence, 
[5]) of the classical result. With the notion of an individual trajectory being 
problematic in the quantum case, in the forthcoming paper [3] we give a 
reformulation of Breiman's theorem, which has an immediate translation 
into the quantum situation. 

2. The Main Results 

Before we state our main theorems we shortly present the mathematical 
description for the physical model of a z/-dimensional quantum spin lattice 
system, at the same time fixing notations. 

The standard mathematical formalism is introduced in detail e.g. in [4] 
and [21]. The ^-dimensional infinitely extended lattice corresponds to the 
group Z u . To each x£Z" there is associated an algebra A x of observables 
for a spin located at site x. It is given by A x = t(x)A, where r(x) is an 
isomorphism and A is a finite dimensional C* -algebra with identity. The 
local algebra Aa of observables for the finite subset A C Z" is given by 
•Aa ■= 0xg/1 "4x- The infinite lattice system is constructed from the finite 
subsets A C Ty . It is described by the quasilocal C*-algebra A°°, which is 
defined as the operator norm closure of U/icZ 1 ' ^a- 

A state of the infinite spin system is given by a normed positive func- 
tional ^ on A°°. It corresponds one-to-one to a consistent family of states 
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{^ a ^}acz^, where each is the restriction of \P to the finite dimen- 
sional subalgebra Aa of .A 00 and consistency means that =^ A ) \ 
Aa for A C A . This one-to-one correspondence reflects the fact, that the 
state of the entire spin lattice system is assumed to be determined by the 
expectation values of all observables on finite subsystems A. Actually, it is 
sufficient to consider boxes only For each }p( A ) there exists a unique den- 
sity operator Da G Aa, such that ^^ A \a) = tr aDa®, a G Aa and tXA is 
the trace on Aa- By S(A°°) we denote the state space of A°°. 
Every x G 7L V defines a translation of the lattice and induces an automor- 
phism T(x) on A°°, which is a canonical extension of the isomorphisms 
for finite A C Z u : 




where T z (x) := r(x)r _1 (z). Then {T(x)} xg y is an action of the transla- 
tion group W by automorphisms on A°°. 

Let G be any subgroup of Z u and denote by T(A°°, G) the set of states, 
which are invariant under the translations associated with G: 

T(A°°,G) := G S(A°°)\9oT(x) =l?,VxG G}. 

We will be concerned in particular with the space of Z^-invariant, i.e. sta- 
tionary states. For simplicity we introduce the abbreviation T(A°°) = 
T(A co ,Z u ). Clearly, T{A°°) C T(A°°,G) for any proper subgroup G 
of Z". 

For n = (m, . . . , n v ) G W we denote by A(n) the box in Z u determined 
by 

A(n) := {(xi, . . . , x u ) G Z v \ Xi G {0, . . . , m - 1}, i G {1, . . . , z^}}, 
and for n £ N the hypercube A(n) is given by 

A(n) :={xer|xe{0,...,n- l} 1 '}. (2.1) 

In the following we simplify notations by defining A^ := Aa{xi) an d 

$r(n) ._ ^(/l(n)) ? for n £ w (respectively for n G N). 

Obviously, because of the translation invariance any ^ G T(A°°) is 

uniquely defined by the family {<^ n )}neN"- 

The von Neumann entropy of (cf. [17]) is defined by: 

S^W) :=-\i A D A ]ogD A , 

where tr A denotes the trace on Aa- For tr^n) we will write tr n . 
It is well known that for every & G T (A°°) the limit 

8 (¥):= lim 1 „ S(ff (n) ) 

yl(n)/w #(A(n)) 
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exists. We call it the mean (von Neumann) entropy. Let I G N and consider 
the subgroup Gi := I ■ Z p '. For a Gi -invariant state \P we define the mean 
entropy with respect to Gi by 

s(!P,Gi):= lim „,}. rr S(^ hn K (2.2) 

Observe that if the state $ is Z^-invariant then we have the relation 
s(W, Gi) = l v ■ s(\P). Further note that in the commutative case the mean 
entropy s coincides with the Kolmogorov-Sinai dynamical entropy h. 
T(A°°, G) is a convex, (weak-*) compact subset of S(A°°) for any sub- 
group G of W . We denote by d^x^iA 00 , G) the set of extreme points of 
T(A°°,G). We refer to elements of d &x T(A°°,G) as G-ergodic states. 
The elements of dexT(A°°) are called ergodic states. 

Now we formulate our main result as a generalization of the Shannon- 
McMillan theorem to the case of non-commutative quasilocal C* -algebras 
.4°° constructed from A, a finite dimensional G*-algebra with identity. 

Theorem 2.1 (Quantum Shannon-McMillan Theorem). Let & be an er- 
godic state on A°° with mean entropy s(tp'). Then for all 5 > there is an 
N,5 G W such that for all n G W with A(n) D A(N 5 ) there exists an 
orthogonal projector p n (5) G A^ such that 

1. ^ n \ Pn (5)) >1-S, 

2. for all minimal projectors A^ with p < p n (5) 

e -#(A(n))(s(*)+5) < ^(n)( p ) < e -#(A(n))(s(#)-5) ^ 

3 e #(A(n))(s(#)-6) < tr n (p n (5)) < e #(Mn))(s^)+S) _ 

Remark: In complete analogy to the classical case the above theorem, in 
particular item 2., expresses the AEP in a quantum context. As will be seen 
in the proof of this theorem the typical subspace given by the projector 
Pn(S) can be chosen as the linear hull of the eigenvectors of which 
have eigenvalues of order e _ #^ n ^ s ^. 

In quantum information theory spin systems on one-dimensional lat- 
tices model quantum information sources. In such a setting essentially 
carrying subspaces of minimal dimension are particularly important for 
formulating and proving coding or compression theorems. As subspaces 
of probability close to 1 they are the relevant subspaces in the sense that 
the expectation values of any observables restricted to these subspaces 
are almost equal to the corresponding ones on the entire space. On the 
other hand the minimal dimension allows an economical use of resources 
(qubits) needed for quantum information storage and transmission. Define 
for e G (0, 1) and n G W 

e ,n(¥) ■= min{log(tr n q)\ q G A {n) projector, ^ n \q) >!-£>, 
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Our next statement, which appears already as a conjecture in the papers [8] 
and [7] of Petz and Hiai, is strongly related to the previous one. In fact, it 
can be considered as a reformulation especially for possible applications to 
(quantum) data compression. 

Proposition 2.1. Let <P be an ergodic state on A°° with mean entropy s(tp'). 
Then for every e £ (0, 1) 

lim — — .. p en (W) = s(&). (2.3) 

In the proof of the quantum Shannon-McMillan theorem this proposition is 
an intermediate result. 



3. Proofs of the Main Results 

A basic tool for the proof of the Shannon-McMillan theorem under the gen- 
eral assumption of ergodicity is the structural assertion Theorem 3.1. It is 
used to circumvent the complete ergodicity assumption made by Hiai and 
Petz. The substitution of the quantum system by a classical approximation 
on large boxes leads to an ergodicity problem for these classical approxima- 
tions. Theorem 3.1 combined with the subsequent lemma allow to control 
not only the mean (per site limit) entropies of the ergodic components (with 
respect to the subshift generated by a large box), but also to cope with the 
obstacle that some of these components might have an atypical entropy on 
this large but finite box. Using these prerequisites, we prove Lemma 3.2 
which is the extension of the Hiai/Petz upper bound result to ergodic states. 
Finally, from the simple probabilistic argument expressed in Lemma 3.3 we 
infer that the upper bound is really a limit. 

Theorem 3.1. Let & € dexT(A°°). Then for every subgroup G[ := I ■ 
7L V , with I > 1 an integer, there exists ak(l) € N 1 ' and a unique convex 
decomposition offy into G [-ergodic states 



^ V V V "' x£yl(k(0) 

The G [-ergodic decomposition (3.1) has the following properties: 

1. kj(l) < I and kj(l)\lfor all j G {1, . . . , v } 
2- {^x}xeA(k«)) = {^o °T(-x)} xeA(m) 

3. For every G [-ergodic state •f'x in the convex decomposition (3.1) of & 
the mean entropy with respect to G[, s(fi^ x , Gj), is equal to the mean 
entropy s(&, G[), i.e. 

s(V x ,G l ) = s(V,G l ) (3.2) 

for all x G A(k{l)). 
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Proof of Theorem 3.1: Let (H&, it&, Qy, Uy) be the GNS representation 
of the C* -dynamical system (^4°°, Z u ). U& is the unitary representation 
of Z u on Tiy. It satisfies for every x G If: 

Uv(x)f2* = f2 9 , (3.3) 

U v (x)ir 9 {a)U£{x:) = 7ry(T(x)a), Va G „4°°. (3.4) 

Define 

•Afr.G, := U 17*(G,), (3.5) 

V 9 , Gl ■= {P G K,G, | P = = ^ 2 }- (3-6) 

By ' we denote the commutant. Observe that J\f<p,G t is selfadjoint. Thus 
Gi (as the commutant of a selfadjoint set) is a von Neumann algebra. 
Further it is a known result that N# Gi is abelian, (cf. Proposition 4.3.7. in 
[4] or Lemma IV.3.4 in [10]). 

Consider some / > 1 such that & d e xT{A°° ,Gi). (If there is no 
such I the statement of the theorem is trivial.) Then 

P* )Gj \{O,l}^0. (3.7) 

In fact, \P dexT{A°° ,Gi) is equivalent to the reducibility of Nv,g v 
(cf. Theorem 4.3.17 in [4]). This means that there is a non-trivial closed 
subspace of H& invariant under the action of tt^(A°°) and U&(Gi). Let P 
be the projection on this subspace and P 1 - = 1 — P . Then P, P 1 - {0, 1} 
and of course P and P 1 - are contained in N$ G . Thus (3.7) is clear. 

Let / be a countable index set. An implication of the Z^-ergodicity 
of the G7 -invariant \P is the following: 

{Qi}iei orthogonal 1 — decomposition in A/^ G; \I\ < V . (3.8) 

To see (3.8) observe at first that for any Q G T-V.gAW the projector 
Uw(x.)QU£(x), x G A(l), belongs to the abelian algebra G; , namely 

7r^(a)C/^(x)Q^(x) = Cfa(x)7r*(T(-x)a)Ql7|(x) (by (3.4)) 

= EAp(x)QMr(-x)a)C#(x) 

= U 9 (x.)QU£(x.)n 9 (a) (by (3.4)) 

holds for every a G A°° and [U#(y), £/^(x)Q£/|(x)] = is obvi- 
ous by [U 9 (y),U 9 (x)] = for all y G G t and x G Z". Thus 
\Uqr (x)QC^(x)} x6 yi(n is a family of mutually commuting projectors. The 
Gelfand isomorphism represents the projectors t/#(x)QJ7,£(x) as contin- 
uous characteristic functions 1q x on some compact (totally disconnected) 
space. Define Q := V x e/l(0 U&(x)QU£{x), which has the representation 
as Vxe/l(/) l<2x = 1(J g/1{;) Qx- Note that Q is invariant under the action of 
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U&(Z U ). From the Z^-ergodicity of & we deduce that Q = 1. If we trans- 
late back the finite subadditivity of probability measures to the expectation 
values of the projectors Uq,(-x.)QU£(-x.) we obtain: 

1 = (f2v,Qf2v) < (n9,U 9 (x)QUp(x)f2 v ) 
= l v ■ (f2v,Qf2v) (by (3.3)). 

Thus (3.8) is clear. 

Combining the results (3.7) and (3.8) we get the existence of an orthog- 
onal 1-decomposition {P;}"^ 1 * n n i — m i nima l projectors Pj G 
"P&,Gi\{®, !}• Here we use the standard definition of minimality: 

P minimal projector in M^q :<^=^ O/Pe ^V,G; and 

Q<P^Q=P VQg^ a \{0} 

The abelianness of N# G implies the uniqueness of the orthogonal 1- 

decomposition {Pi}™!^ 1 . Further it follows that {Pjj"^ 1 is a generating 
subset for V^ : Gi in the following sense: 

s 

Q G Vy, Gl => ^{Pi^jZo 1 ' 1 C V 9 , Gl such that Q = £ P ty (3.9) 

3=0 

Define := {fi&, P%^) and order the minimal projectors Pj such that 

Po<Pi, Vi€{l,...,n,-1}. (3.10) 

Let 

G(P ) := {x G Z"| C/(x)P C/*(x) = P }. 

Note that G(Po) is a subgroup of Z u and contains Gu since Po € P<p,Gr 
This leads to the representation 

V 

G(P ) =0fcj(Z)Z, with for all j G 

where the integers fcj(Z) are given by 

fcj(Z) := min{xj| Xj is the j-th component of x G G(Po) and Xj > 0}. 

For P , as an element of {^(x)P()E^(x)}xe/l(k(0) C 

for k(Z) = (fci(0, • • • ,M0)- Thus by (3.9) each C/^(x)P ?7^(x), x G 
yl(k(Z)), can be represented as a sum of minimal projectors. But then by 
linearity of the expectation values and the assumed ordering (3.10) each 
C/^(x)PoZ7^(x) must be a minimal projector for x G A(k(l)). Other- 
wise there would be a contradiction to (f2&, L^(x)PoC/^(x)^) = po- 
Consequently {^(x)P Z7|(x)} xe/1(k(0) C {P;}™^ 1 . Consider P = 
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Sxg/l(k(/)) ^K x )-fWi£( x )- Obviously Po is invariant under the action of 
U^r(Z u ) and because of the Z^-ergodicity of ^ 

P = l. 

It follows by the uniqueness of the orthogonal 1 -decomposition 

{Mx)P C/£(x)} x6yl(k(0) = {Pj}]^ 1 - 

Obviously n\ = #(A(k(l))) and for each Pi, i G {0, . . . , n/ — 1}, there is 
only one x € A(k(l)) such that 

Pi = U 9 (xl)P UMx) =: P x . (3.11) 

It follows = po f° r all i G {0, . . . , nj — 1} and hence 

K = r#(«j)' ^{0,..,n z -l}. 
Finally, set for every x € A(k(l)) 

!P x (o) := #(/l(k(/)))(^,Px^(a)^), a G *4°°. 
From (3.11), (3.3) and (3.4) we get 

V x (a) = #{A{k{l)))(f2v,P x Tr*{a)f2v) 

= #(yl(k(Z)))(^,Po7r^(T(-x)a)^) 
= !Pb(T(-x)a), oGi°°, 

hence 

^ l 1 1 ])) xeA(k(0) xeA(k(0) 

= #(a). 

Thus we arrive at the convex decomposition of W: 

*-#mm E s>0 ° r( ~ x) ' 

7rv v v xeA(k(i)) 

By construction this is a G^-ergodic decomposition of It remains to prove 
the fact that the mean entropies with respect to the lattice Gi are the same 
for all GVergodic components & x . 

Proof of item 3.: It is a well known result that the quantum mean entropy 
with respect to a given lattice Gi is affine on the convex set of Gi -invariant 
states, (cf. prop. 7.2.3 in [21]). Thus to prove (3.2) it is sufficient to show: 

s(^,G l ) = s(%,G l ), Vx€A(k(l)). 



The Shannon-McMillan Theorem for Ergodic Quantum Lattice Systems 



11 



By the definition of the mean entropy this is equivalent to the statement 

\S(V$ n) ) - S(¥$ n) )\ = o(\n\) asn^oo. (3.12) 

This can be seen as follows: In view of the definition of iff 11 ' we have 

S(^ n) ) = S(&i A(ln)) ) = S{^ A{ln) ~ x) ). We introduce the box A being 
concentric with A(ln), with all edges enlarged by I on both directions, i.e. 

an i-neighborhood of A(ln). The two expressions S(^ n) ) and 5(^ n) ) 

are von Neumann entropies of the restrictions of to the smaller sets 
A(ln) and A(ln) — x, respectively. On the other hand we consider the box 
A being concentric with A(ln) with all edges shortened by I at both sides. 
S(\Pq^) is the von Neumann entropy of \p^ A<ylxi ^ and ^ A( - ln ^ after their 

restriction to the set A. S{W^ lvL ^) and S(^Q A ^ a ^) can be estimated si- 
multaneously using the subadditivity of the von Neumann entropy 

S{*i A) ) - logtr^l < S{^) < S(V^) + logtr^^l, 
where \ G {x, 0}. Thus (3.12) is immediate. □ 

In order to simplify our notation in the next lemma we introduce some 
abbreviations. We choose a positive integer / and consider the decompo- 
sition of if G d ex T(A°°) into states lf x being ergodic with respect to the 
action of G h i.e. <f = #(yl( 1 k(0)) ExeA(k(0) Then we set 

s := s(V,Z") = s(&), 

i.e. the mean entropy of the state "f computed with respect to W . Moreover 
we set 

From the previous lemma we know that 

s(9 x , G t ) = s{W, G,) = l v ■ 8 (9), Vx € yl(k(0). (3.13) 
For r\ > let us introduce the following set 

A ltV := {x e yl(k(Z))| 4° > s + rj}. (3.14) 

By Af we denote its complement. The following lemma states that the 
density of G/ -ergodic components of !f which have too large entropy on 
the box of side length I vanishes asymptotically in I. 
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Lemma 3.1. Ifty is a W-ergodic state on A°°, then 

#A(k(l)) 

holds for every rj > 0. 



Proof of Lemma 3.1: We suppose on the contrary that there is some % > 
such that lim sup z ^^(i)) = a > 0. Then there exists a subsequence (lj ) 
with the property 

By the concavity of the von Neumann entropy we obtain 

= E + E ^ 

> #A • (a + m) + • x JPP s * j) • 

Here we made use of (3. 14) at the last step. Using that for the mean entropy 
holds 

s(!Px,G,) = lim —l—Si^) = inf —L-S(¥<! m) ) 
/l(m)/W #A(m) A(m) #A(m) 

we obtain a further estimation for the second term on the right hand side: 

#i4 U • xeT 1 ^ ^ • X JPP 

= #Al m .s(V) (by(3.13)). 

After dividing #^(k(/,)) ■ > ■ (a + %) + #^, T;o ■ 

by #yl(k(^)) and taking limits we arrive at the following contradictory 

inequality: 

s > a(s + 7]o) + (1 — a)s = s + ar]o > s. 
So, a = 0. □ 



Lemma 3.2. Le? 1^ fee an ergodic state on A 00 . Then for every e 6 (0, 1) 
limsu P 3T77^^."(^) ^ 
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Proof of Lemma 3.2: We fix e > and choose arbitrary 77, 5 > 0. Consider 
the Gi -ergodic decomposition 

= I v v. 

#A(k(l)) ^ x 
^ v K 11 xeA(k(0) 

of ^ for integers / > 1. By Lemma 3.1 there is an integer L > 1 such that 
for any I > L 

\ - #Am)* Al ' v - 

holds, where is defined by (3.14). This inequality implies 

#W^,-(i-|)>i- £ . <«» 

On the other hand by 

S(&^) = mf{S(& (n) \B)\B maximal abelian C* - subalgebra of ^ n )} 

(cf. Theorem 11.9 in [16] and use the one-to-one correspondence be- 
tween maximal abelian *-subalgebras and orthogonal 1-decompositions 
into minimal projectors contained in ^4( n )) there exist maximal abelian C*- 
subalgebras B x of Aa(i) with the property 

^—S{V X A{1)) \ B x ) < sW+r), Vxe Al v . (3.16) 

We fix an / > L and consider the abelian quasi-local C* -algebras £>£°, 
constructed with B x , as C*-subalgebras of A°° and set 



to. 



:= <^ x t B™ and m x n) :=$ x \ B { x ] 



for x € Af and n G W. The states to x are G\ -ergodic since they are re- 
strictions of Gi -ergodic states } & x on a quasi-local algebra. This easily fol- 
lows from Theorem 4.3.17. in [4]. Moreover, by the Gelfand isomorphism 
and Riesz representation theorem, we can identify the states m x with prob- 
ability measures on corresponding (compact) maximal ideal spaces of B x . 
By commutativity and finite dimensionality of the algebras B x these com- 
pact spaces can be represented as B x " with finite sets B x for all x £ Af^. 
By the Shannon-McMillan-Breiman theorem (cf. [18], [14]) 

,H m ~ jl Ti \ lograx n) (^n) = h x (3.17) 
/i(n)/w #A(n) 

m x -almost surely and in L 1 (m x ) for all x G Af^, where h x denotes the 

Kolmogorov-Sinai entropy of m x , and uj n € B X A ^ are the components 
of 10 € B^" corresponding to the box A(n). Actually, as we shall see, 
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we need the theorem cited above only in its weaker form (convergence in 
probability) known as Shannon-McMillan theorem. For each n and x € 
^let 

c x n) ■■= W n e 4 n) | I - — logm^K) - K\ < 5} 

#A{n) 

= Wn G #| e~# A ^< h ^ < m^\u n ) < e -#^W-(^-*)}. 

Since lower bounds on the probability imply upper bounds on the cardinal- 
ity we obtain 

#ci n) = tr n (j4 n) ) < e * A ^ h * + V < e #^)in*(*)+n)+S) (3 .i 8) 

where is the projector in B^ corresponding to the function 1 („) . In 

the last inequality we have used that h x < S(& X A ^ \ B x ) < l u {s(&) + 77) 
for all x € Af„ by 

^ = lim x^rT^rf) = inf ^TT^rf), 
A(n)/ , N" #^l(n) /l(n) #^l(n) 

(cf. [21]), and by (3.16). Here H denotes the Shannon entropy. 

From (3.17) it follows that there is an N € N (depending on /) such that 

for all qgN" with A(n) z> A(N) 



m^ n) (d n) )>l-|, VxeiJ,. (3.19) 



For each y € N 1 ' with y« > 7V7 let yi = + ji, where ni > N and 
< ji < I. We set 

» 



and denote by q y the embedding of g in „4,( y ). By (3.19) and (3.15) we 
obtain 

^ v w; xeA(k(0) 

2 #3^(0)*^ -J 1 -^ 2 <'-'»■ 

Thus the condition in the definition of (3 e y is satisfied. Moreover by 
(3.18) 

<log Y: e# A ^< h ^ + tr A{y)XA{ln) l 
xeAf 
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< log#^ • e #%)(H S (^.)^)) +tt%)Wn) i 

< log #Af !r) + #A(n)(l»(s(V) +r,) + S) 

+tTyl(y)\yl(Jn)l 

< log #Al v + #(A(y))(s(^) + n + 5) 

+tTyl(y)\yl(in)l- 

We can conclude from this that 

UmSUP 4l.(A( v -\\ Pe>yW ~ S ^ + 71 + 5 ' 

because #Af v does not depend on n and ^l(y) /* N 1 ' if and only if 
7l(n) / N". This leads to 



limsup JJ _ AI - j3 £ ,y{&) < s(&), 



1 

since ij, S > were chosen arbitrarily. □ 



Let i/ € N. For n = (m, . . . ,n u ) G we define |n| := Yli=i n * 
and write n — > oo alternatively for A(n) f W. Further we introduce the 
notation 

n > m :<^=^> rii > rrii, Vi G {1, . . . , i/}. 

Recall that for a probability distribution P on a finite set A the Shannon 
entropy is defined by 

H(P) := -£P(a) log P(a). 

agA 

Lemma 3.3. Le? Z) > a«<i {(^( n ), -P ( - n - ) )}neN 1 ' ^ a family, where each 
AW is a^nte wiffc ^| log #^ n ) < L>/or a// n G N" and P^ is a 

probability distribution on A^K Define 

a £ ,n{ p(n) ) :=min{log#^| Q C ^ (n) ,P (n) (J?) > 1 - e}. (3.20) 
If {{A^ n \ P^)}n£H» satisfies the following two conditions: 

1. Mm^ 00 -^H{P^)=h<oo 

2. limsup^ ^a £ ,„(P (n) ) < h, Ve G (0, 1) 

then for every e G (0, 1) 

lim ^a £in (p(")) = fc. (3.21) 

n^oo n 
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Note that we do not expect either {^^jneN" or {P^jneN^ to fulfill any 
consistency conditions. We will see later on that this is the important point 
for why Lemma 3.3 will be useful in the non-commutative setting. 

Proof of Lemma 3.3: Let 5 > and define 

A^(S) := [a G A^ | P^ (a) > e -H(*-«)} , 

4 n) (<5) := {a G A™ I e -l n K fe + 5 ) < p(") (a) < e H n l( ft - 5 )} , 

4") (J) : = { a G A^ I pH ( a ) < e -M(h+*)} . 

We fix an arbitrary <5 > and use the abbreviation = 4"^)' 

i G {1, 2, 3}. To see that lim p( n ) f Ai n)> ) = assume the contrary and 

observe that the upper bound on the probability of elements from A^ im- 
plies a lower bound on the cardinality of elements from A^ needed to 
cover say an e— fraction, e G (0, 1), of A^ with respect to p( n \ Namely 
one has min |#C | C C A^,P^ (C) > e} > e ■ e^ h+s ^ which con- 
tradicts condition 2 in the lemma. Furthermore the set A^ cannot asymp- 
totically contribute to the mean entropy h since 



~ Yj ^ (n) (a)log^ (n) (a) 



<— V p( n )( a )log— l —P n (A%) 

and 

lim V pW( a )log— Vr p(n) (4 n) ) 

= Jim |1 (P^ (4 n) ) log #4 n) - PW (^^ n) ) log PW (4 n) )) = 0. 

Here we used the fact that log j^ ( ) stays bounded and — E Pi log Pi < 
-EPil°g% for finite vectors (p,) , (%) with EiPi = Ej % < 
1 and > 0. Since Ag 11 ' 1 does not contribute to the entropy 

one easily concludes that lim P*") [A^ ) = because otherwise 

liminfn^oo ±H (p( n )) < h would hold. Recall that S > was cho- 
sen arbitrarily. 
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Thus 

lim P(") (A { "\5)) =1, V<5 > 0. (3.22) 

Consequently the lemma follows since P( n ) (Q) > 1 - e implies 
P(°) (ft n A { 2 n) (5^j > (1 - e) 2 for |n| sufficiently large and one needs at 

least (1 - ef ■ e^'V elements from A { f> \S) to cover 12 D (6) and 
5 can be chosen arbitrarily small. □ 

Proof of Proposition 2.1: _4.( n ) as a finite dimensional C* -algebra is 
isomorphic to a finite direct sum ®f =1 B(Hf \ where each uf ] is a 
Hilbert space with dim7ij n ^ = df^ < oo and any minimal projector in 
_4.( n ) is represented by a one-dimensional projector on := ©jii 

with dim7^ n ) = J2f=i df ] =■ dn- Note that ©^ B{uf ] ) C B{H^). 
Consider the spectral representation of the density operator D n of in 

Dn = EAj n) |,l n) )^ n) |, \W e [0>1]j |,(n) } £ W (n). 
i=i 

For n = (m, . . . ,n v ) G W let A^ be the finite set consisting of the 
eigen-projectors qf^ := l?^) (d^l of \p( n \ i.e. 

AW := {^ (n) }ti- (3-23) 
Let P( n ) be the probability distribution on A^ given by: 

p(n) (g (n) );= ^(n)^)) = A (n)_ (324) 

Recall that |n| = H" =1 m. Let P> := log(dimH (0) ), then X log #A^ < 

D for all n G N". We show that the family {(^ n ), P (n) )} ne rr fulfills both 
conditions in Lemma 3.3 and consequently 

lim -La E JPW) = lim -!-F(p( n )), Ve€(0,l). (3.25) 

n— >oo n ' n^oo n 

It is clear that H(P^) = - ^=1 lo S ^ = S($^). Thus 

h := lim — H(P^) = s(¥). (3.26) 

n^oo n 

Next assume the following ordering: 

i < 3 => Aj n) > \f ] 
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and define for e G (0, 1) 

k 



n e , n :=niin{A;e{l,...,dn}| £ X j ^ 1 " e i- 

3=1 

Thus a £ , n (p( n )) = log #({(7, {n) }"=!") = logn £ , n . We claim : 

ae,n(P (n) ) = Ps,n(* in) ), ^ G (0, !)• 0-27) 

From -^(E^i ^ (n) ) > 1 - £ and tr n ^ {n) = n £ , n it is obvious 

that/3 £ , n (^ n )) <a £ , n (pW). 

Assume /3 £ , n 0^ n ^) < «e,n(-P ( ' n - > )- Then there exists a projector q G .A*") 
with &( n \q) > 1 - e such that m := tr n q < n £i „. Let YT=\ \Qi)(Qi\> 
where \qi) G 7i^ n \ be the spectral representation of q. For L> n as density 
matrix on we use Ky Fan's maximum principle, [2], and obtain the 
contradiction 

m m 

1 _ e < ^(n) ((?) = trnZ?n(? = ^{ qi , D nQi ) < A 4 (n) < 1 - e. 

i=i i=i 

•Z' is ergodic. Thus we can apply Lemma 3.2: 

limsup 1 ,, /3 £ ,n(^ (n) ) < s(V), ye G (0, 1). (3.28) 

/l(n)/W #\ A { n )) 

Setting (3.27) and (3.26) in (3.28) and using that #(A(n)) = |n| we obtain 

lim sup — a £ ,„(P (n) ) < /i, Ve € (0, 1). (3.29) 

n^oo |n| 

With (3.26) and (3.29) both conditions in Lemma 3.3 are satisfied. It fol- 
lows (3.25). Now we set back (3.27) and (3.26) in (3.25) and arrive at 

/l(n)/W #(vl(n)) 

Proof of the Quantum Shannon-McMillan Theorem: 

Fix 5 > 0. Adopt the family {(A (n) , P (n) )} nGN ^ and further notations 

from the proof of Proposition 2.1. Choose some 5' < 5. Let A^ (5') be 
the subset of A^ defined in the proof of Lemma 3.3 with h = s(&), 
appropriate to (3.26). Let 7 n (<5') := {i G {1, . . . , d n }\ qf G A^ ] (5')}. Set 

Pn{S) = £ «?" 

In(S') 
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By (3.22) there exists an N5 G W such that p n (5) is a projector with 

f (n) (Pn(<5)) = P (n) (4 n V)) > 1 - S, Vn > N s . 

Any minimal projector / p 6 ,4.( n ) with p < p n (5) is represented as a 
one-dimensional projector on H^, such that |p) = Yliei n (5') iMT) 
and E ie / n (5') 7? = 1- Hence 

is a weighted average of the eigenvalues corresponding to the set 
A^\5'). Thus we obtain by the definition of this set 

e -#A(n)(s(V)+8) < ^(n)^ < e -#A(n)( a (*)-*)_ (3 _ 30) 

Using the linearity of !^( n ) and applying (3.30) to the projectors qf^ we 
arrive at the following estimation 

if n is large enough. We have shown all assertions of the theorem. □ 



4. Comment 

It seems that our result can be extended to the case of discrete amenable 
group actions on quasilocal C*— algebras. Limits in this situation have to 
be taken along tempered F0lner sequences. The relevant classical theorem 
in this setting can be found in [14]. 
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